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Two Theorems on Matrices* 



Morris Newman 
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Generalizations of theorems important in the iterative solution of systems of linear 
equations are given, together with a lemma on the solution of a certain matrix equation. 
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In this note we generalize two theorems on mat- 
rices which are of importance in certain iterative 
schemes for the solution of systems of linear equa- 
tions (see [1] and [3] for relevant references).^ In 
addition we prove a lemma on the solution of certain 
matrix equations. Although the proofs are simple, 
the results are of interest and find application in 
computations with matrices. However, we forego 
the discussion of these applications here. 

In what follows i^ and M are n X n nnitiices and 



denotes ^^conjugate transpose." We set 



(1) 



and assume that Jl and S are luH'iiiitian. We 
write p.d. for positive definite, n.s.d. for negative 
semi-definite, etc. The theorems we wish to prove 
follow. 

Theorem 1. //R and S are both p.d. or both n.d. 
then every eigenvalue of M is' of modulus less than 1 . 7/ 
R is* p.d. and S n.d. or if R is' n.d. and S p.d.;, then 
every eigenvalue of M is of modulus greater than 1 . 

Theorem 2. If every eigenvalue of M is of modulus 
less than 1, then R is p.d. if S is p.d. and n.d. if S 
is n.d. If every eigenvalue of M is of modulus ^1, 
then R is p.d. if ^ is n.d. and n.d. if^ is p.d. 

Before giving the proofs of these theorems we 
state two lemmas. The first is well-knowu and we 
omit the proof. The proof of the second is given 
in detail. 

I^etA={aij) be an arbitrary nXn complex matrix. 
If B={bij) is a non-negative matrix such that \aij\ 
<bij, we shall write A<^<^B. It is trivial to verify 
that if ^i<<Bi, A2«B2 then A+A<<^^i + ^^2, 
AiA2«iBiB2. Further, let M{A) denote the abso- 
lute value of an eigenvalue of largest modulus of A. 

Lemma 1. Let A be an arbitrary nXn complex ma- 
trix. Then there is a fixed non-negative matrix B 
such that for every integer r>0, 



A'<:<:r^-'M{AyB. 



(2) 



Tliis lemma is well-known and a proof can be given 
using the Jorchm normal form of the matrix A. The 
term r^~^ can be replaced by r^'*"^ where m is the 



order of a largest Jorchm block of A. 
paper [2] by A. Ostrowski. 



See also the 



*The preparation of this paper was supported by the Office of Naval Research. 
1 Figures in brackets indicate the hterature references at the end of this paper. 



L^MMA 2. Let A,B,C be nXu complex matrices and 
suppose that 

p=M{A)M{B)<:i. (3) 

Then the matrix equation 

X-AXB=C (4) 

has a unique solution X given by the infinite series 

X=f:,A'CR^-C+AaB+A^CB'+ (5) 

r=0 

Proof. Set 

X^=(\ Xr,^^AXrB+C, /•>0, (6) 

so that 

Xr=C+ACB+ . . , -\-A'CB\ 

If /' and p are non-negative integers then it is easy to 
verifv that 

Xr^,-Xr-^ = A^X,B\ 

By l(Miiiiia ] tliere aro non-iu'native mutrices U, 
V, W, indepcii(l(M)t of /• such I hut 

A'<:<Cr''-'M{AyU, C«V, B'<:<:r''-IM{B)W. 

Set T= UVW. Then 

r=0 \r=0 / 

where p is defined by (3). Since 0<p<l, this im- 

00 

plies that ^r^^^^p' converges, and that 



^.«(|:'-^"-v): 



Hence lenuna 1 implies that there is a non-negative 
matrix K independent of r and p such that 



-^T + p — Xr - 1 <C <C^' 



m. 



(7) 



From (3) and (7) it follows easily that the se- 
quence {Xr} is a Cauchy sequence converging to a 
limit X, and (6) implies that X=AXB-\-C and that 
X satisfies (5). To show that the solution X is 
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unique, let Y be any other solution. Then Y—X 
=A{Y-X)B and by iteration, Y-X=^A'{Y-X)B' 
for every non-negative integer r. Hence there is a 
non-negative matrix L independent of r such that 
F— X<<r2^-Vi. Lettmg r go to infinity, (3) im- 
plies that Y=X. The proof of the lemma is com- 
plete. We go on to the proof of theorem 1. 

Let X be an eigenvalue of M, v a corresponding 
eigenvector, and setf=v'^Fr, r=v'^Rv, s=v'^Sv. Then 
(1) implies that 



^=/+V, s=J-\J. 



(8) 



Assume that i? and S are definite matrices. Then 
X 7^ — 1 and we can eliminate / from (8) . We obtain 



1- 



ii+xr 



(9) 



Theorem 1 is implied by (9) since r/5>0 if B and 
S are both p.d. or both n.d., and r/s<^0 if i? is p.d. 
and S n.d. or R is n.d. and S p.d. 

We now turn to the proof of theorem 2. If we 
eliminate F from (1) (remembering that B and S 
are hermitian) we obtain 



(I+M'')S(I+M)=B-M''BM. 



(10) 



If we assume that every eigenvalue of M is of 
modulus less than 1 then lemma 2 applies and we 
obtain 



^=S (M*)''(/+M*)S(7+^/)M^ 

r=0 



(11) 



Since the sum of any number of p.s.d. matrices is 
p.s.d. and the sum of any number of n.s.d. matrices 



n.s.d., the matrix B is p.s.d. if aS is p.s.d. and n.s.d. 
if S is n.s.d. But the first term of the sum (11) is 
p.d. if aS is p.d. and n.d. if S is n.d. Thus the first 
part of theorem 2 is proved. 

Assume now that every eigenvalue of M is of 
modulus greater than 1. Then M is nonsingular and 
every eigenvalue of N=M~^ is of modulus less than 
1. Equation (10) vcl^j be written 

{I+m)S{I+N) =N''BN-N, (12) 

Once again lemma 2 applies and we obtain 



B=-J: {N''y(I+N'')S{I+N)N', (13) 

r=0 

from which the second part of theorem 2 follows. 
This concludes the proof of theorem 2. 

For related theorems, see the paper [4] by P. Stein. 
Lemma 2 of our paper can be used to provide a 
simplified proof of the theorems given by Stein in 
[4] and indeed to generalize these theorems. 
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